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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed Dec. 23, 2004 have been fully considered but they 
are not persuasive. 

Applicants argue that writing a VISS mark in the control track of a tape after 
displaying "an instruction for the user to advance the tape to the start of the first 
program" and recording a voice title to a camcorder or VCR at the same time the 
camcorder or VCR is recording the content being marked of Kwoh do not satisfy the 
requirement recited in claim 1 that "the non-contemporaneous mark is associated is 
neither being obtained by the recording unit nor displayed to the user and other 
recording data of activities occurring at the marking time is being obtained by the 
recording unit" and the requirement recited in claim 45 that "wherein the non- 
contemporaneous mark is specified by the user at a time when the recording data with 
which the non-contemporaneous mark is associated is neither being obtained by the 
recording unit nor displayed to the user and other recording data of activities occurring 
at the marking time is being obtained by the recording unit". 

In response, the examiner respectfully disagrees. As recognized by applicants 
that Kwoh discloses writing a VISS mark in the control track of a tape after displaying 
"an instruction for the user to advance the tape to the start of the first program" and 
recording a voice title to a camcorder or VCR at the same time the camcorder or VCR is 
recording the content being marked and Kwoh also discloses in page 2, paragraph 
#0036 that "Instead of recording voice title 250 in audio track 242, it could be recorded 
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in the vertical blanking interval of video signal before, during, or after recording". It is 
noted that recording voice title in the vertical blanking interval of the video signal before 
and after recording anticipates claimed limitation "the non-contemporaneous mark is 
associated is neither being obtained by the recording unit nor displayed to the user and 
other recording data of activities occurring at the marking time is being obtained by the 
recording unit" as recited in claim 1 and the limitation "wherein the non- 
contemporaneous mark is specified by the user at a time when the recording data with 
which the non-contemporaneous mark is associated is neither being obtained by the 
recording unit nor displayed to the user and other recording data of activities occurring 
at the marking time is being obtained by the recording unit" as recited in claim 45. 

Claim Rejections - 35 USC § 103 
2. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of 

the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 

the various claims was commonly owned at the time any inventions covered therein 

were made absent any evidence to the contrary. Applicant is advised of the obligation 

under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 

not commonly owned at the time a later invention was made in order for the examiner to 
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consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

3. Claims 1-5, 8, 10-11, 13-14, 17-21, 29-31, 35-36, 41, 44-49, and 52-53 are 
rejected under 35 U.S.C. 103(a) as being unpatentable over Kwoh et al (US 
2002/0031331 Al) in view of Cobbley et al (US Patent No. 5,818,510) as set forth in the 
last Office Action. 

Regarding claim 1 , Kwoh et al, as discussed in the last Final Office Action, 
discloses a recording unit (Fig. 2) for recording an event, comprising: 

a data acquisition device (camera electronics 204 of Fig. 2, page 2, paragraph 
#0035) for obtaining recording data representing the content of the event; 

a data storage device (tape 212 of Fig. 2, page 2, paragraph #0035) for storing 
data, including recording data; 

a control interface device (controls 216, play 220, record 218, and voice title 222 
of Fig. 2, keyboard 32 of Fig. 4, page 2, paragraph #0035, page 3, paragraph #0043, 
page 4, paragraphs #0047, #0049, and #0050, and page 5, paragraph #0057) for 
enabling a user to control operation of the recording unit, the control interface device 
further comprising marking means for enabling the user to specify multiple types of non- 
contemporaneous marks; and 

a system controller (microcontroller 214 of Fig. 2, page 2, paragraphs #0035 and 
#0036) that causes, in response to the specification of a non-contemporaneous mark by 
the user, the data storage device to store marking data associating the non- 



Application/Control Number: 09/557,081 Page 5 

Art Unit: 2616 

contemporaneous mark with recording data obtained at a marked time different from the 
marking time at which the non-contemporaneous mark was specified by the user; 

wherein the non-contemporaneous mark is specified by the user at the time 
when the recording with which the non-contemporaneous mark is associated is neither 
being obtained by the recording unit nor displayed to the user and other recording data 
of activities occurring at the marking time Is being obtained by the recording unit (page 
2, paragraphs #0035 and #0036); wherein each of the multiple types of non- 
contemporaneous marks has a different meaning that is defined by its marking definition 
(page 3, paragraph #0043 and page 5, paragraph #0057). However, Kwoh et al does 
not specifically disclose the claimed "a user Interface associated with the control 
Interface device, the user Interface being configured to enable the user to specify, prior 
to the recording data being obtained by the data acquisition device, a desired meaning 
for at least one of the multiple types of non-contemporaneous marks". 

Cobbley et al teaches, an apparatus for providing broadcast Information with 
indexing, a user a user interface associated with the control interface device, the user 
interface being configured to enable the user to specify, prior to the recording data 
being obtained by the data acquisition device, a desired meaning for at least one of the 
multiple types of non-contemporaneous marks (col. 4, lines 13-41) to allow the user to 
quickly and easily access the stored information (col. 2, lines 1-2). 

It would have been obvious to one of ordinary skill In the art at the time of the 
invention to incorporate the user Interface as taught by Cobbley et al into Kwoh et al's 
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system in order to simplify the process of accessing the stored information as 
suggested by Cobbley. 

Regarding claim 2, Kwoh et al discloses the claimed wherein the marking means 
is adapted to enable specification of a retrospective mark that is associated with 
recording data obtained at a marked time prior to the marking time at which the 
retrospective mark was specified by the user (pages 2-3, paragraphs # 0036 and 
#0037). 

Regarding claim 3, Kwoh et al discloses the claimed wherein the marking means 
is adapted to enable specification of a predictive mark that is associated with recording 
data obtained at a marked time subsequent to the marking time at which the predictive 
mark was specified by the user (pages 2-3, paragraphs #0036 and #0037). 

Regarding claim 4, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time and a duration of time, the marked time being the time 
different from the marking time by the amount of the duration of time (page 2, paragraph 
#0035 and pages 4-5, paragraph #0055). 

Regarding claim 5, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time directly (page 2, paragraph #0035). 

Regarding claim 8, Kwoh et al discloses the claimed wherein the marking data 
further defines a range of time relative to the marked time (page 2, paragraph #0035 
and pages 4-5, paragraph #0055). 

Regarding claim 10, Kwoh et al discloses the claimed wherein the marking 
means further comprises: 
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means for indicating that a voice mark is to be imminently specified (page 2, 
paragraph # 0035); and 

means for identifying a voice mark (page 2, paragraphs #0035 and #0036), the 
means for identifying operable in response to an indication that a voice mark is to be 
imminently specified. 

Regarding claim 1 1 , Kwoh et al discloses the claimed wherein the recording unit 
is portable (page 2, paragraph #0034). 

Regarding claim 13, Kwoh et al discloses the claimed wherein the data 
acquisition device further comprises a visual data acquisition device (the monitor 232 of 
Fig. 2, page 2, paragraph #0035). 

Regarding claim 14, Kwoh et al discloses the claimed wherein the data 
acquisition device further comprises an audio data acquisition device (the microphone 
224 of Fig. 2, page 2, paragraph #0035). 

Regarding claim 17, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating a level of importance or interest of the 
content which the marked recording data represents (pages 2-3, paragraphs #0036 and 
#0037 and pages 4-5, paragraph #0055). 

Regarding claim 18, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating a characteristic of the content which the 
marked recording data represents (pages 2-3, paragraphs #0036 and #0037 and pages 
4-5, paragraph #0055). 
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Regarding claim 19, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating the beginning or end of activity of interest 
(pages 2-3, paragraphs #0036 and #0037 and pages 4-5, paragraph #0055). 

Regarding claim 20, Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating the recording conditions (pages 2-3, 
paragraphs #0036 and #0037 and pages 4-5, paragraph #0055). 

Regarding claim 21 , Kwoh et al discloses the claimed wherein the multiple types 
of marks include one or more marks indicating the user's state of mind (page 2, 
paragraph #0035). 

Regarding claim 29, Kwoh et al discloses the claimed 

means (page 2, paragraph #0035) for analyzing the recording data; and 

means (page 2, paragraphs #0032 and #0035 and page 3, paragraph #0040) for 
changing the meaning of a mark based on the analysis of the recording data. 

Regarding claim 30, Kwoh et al disclosed the claimed means (microphone 224 of 
Fig. 2, page 2, paragraph #0035 and page 3, paragraph #0040) for obtaining data other 
than recording data; and 

means for changing the meaning of one or more marks based on the data other 
than the recording data (page 2, paragraph #0035 and page 3, paragraph #0040). 

Regarding claim 31 , Kwoh et al discloses the claimed one or more marking 
tokens (page 2, paragraphs #0032 and #0035) for enabling a person to specify a 
corresponding type of mark, each marking token adapted to enable physical separation 
of the marking token from the control interface device. 
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Regarding claim 35, Kwoh et a! discloses the claimed wherein the system 
controller causes, in response to the specification of a mark by the user, operation of 
the recording unit in a predetermined manner in accordance with the type of the mark 
(page 2, paragraphs #0032 and #0035). 

Regarding claim 36, Kwoh et al discloses the claimed wherein at least one mark 
indicates a level of importance or interest of the content which the marked recording 
data represents (page 2, paragraph #0035). 

Regarding claim 41 , Kwoh et al discloses the claimed wherein the means (voice 
title 222 of Fig. 2, page 2, paragraph #0035) for producing a mark further comprises 
means for producing a mark and/or supplementing or modifying an existing mark based 
on the value of, or an analysis of, data acquired by the recording unit; and 

wherein the recording unit further comprises means (voice title 222 of Fig. 2, 
page 2, paragraph #0035) for acquiring non-visual, human perceptible data other than 
recording data; and the means for producing a mark and/or supplementing or modifying 
an existing mark produces, supplements or modifies based on the value of, or an 
analysis of, the none-visual, human perceptible data other than the recording data 
(voice title 222 of Fig. 2, page 2, paragraph #0035). 

Regarding claim 44, Kwoh et al discloses the claimed wherein the means for 
producing a mark and/or supplementing or modifying an existing mark produces, 
supplements or modifies based on the proximity of the marking time to the marked time 
(page 2, paragraph #0035), 
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Regarding claim 45, Kwoh et al discloses for use in a recording unit being used 
by a user for recording an event, a method (Fig. 2) for non-contemporaneously marking 
recording data obtained by the recording unit, comprising the steps of: 

identifying the specification of a non-contemporaneous mark of the specified 
type(voice title 222 of Fig, 2, page 2, paragraph #0035); and 

in response to an identification of the specification of a non-contemporaneous 
mark, storing marking data associating the non-contemporaneous mark with recording 
data obtained at a marked time different from the marking time at which the non- 
contemporaneous mark was specified and other recording data of activities occurring at 
the marking time is being obtained by the recording unit (page 2, paragraphs #0035 and 
#0036); wherein the non-contemporaneous mark is specified by the user at a time when 
the recording data with which the non-contemporaneous mark is associated is neither 
being obtained by the recording unit nor displayed to the user (page 2, paragraphs 
#0035 and #0036). However, Kwoh et al does not specifically disclose the claimed 
"specifying a desired meaning for a type of mark prior to obtaining the recording data". 

Cobbley et al teaches, an apparatus for providing broadcast information with 
indexing, a user a user interface associated with the control interface device, the user 
interface being configured to enable the user to specify, prior to the recording data 
being obtained by the data acquisition device, a desired meaning for at least one of the 
multiple types of non-contemporaneous marks (col. 4, lines 13-41 ) to allow the user to 
quickly and easily access the stored information (col. 2, lines 1-2). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the user interface as taught by Cobbley et al into Kwoh et al's 
system in order to simplify the process of accessing the stored information as 
suggested by Cobbley. 

Regarding claim 46, Kwoh et al discloses the claimed wherein: 

the step of identifying further comprises identifying the specification of a 
retrospective mark (voice title 222 of Fig. 2, page 2, paragraph #0035); and 

the step of storing further comprises storing marking data associating the 
retrospective mark with recording data obtained at a marked time prior to the marking 
time at which the non-contemporaneous mark was specified (page 2, paragraphs #0035 
and #0036). 

Regarding claim 47, Kwoh et al discloses the claimed wherein: 

the step of identifying further comprises identifying the specification of a 
predictive mark (voice title 222 of Fig. 2, page 2, paragraph #0035); and 

the step of storing further comprises storing marking data associating the 
predictive mark with recording data obtained at a marked time subsequent to the 
marking time at which the non-contemporaneous mark was specified (page 2, 
paragraphs #0035 and #0036). 

Regarding claim 48, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time and a duration of time, the marked time being the time 
different from the marking time by the amount of the duration of time (page 2, paragraph 
#0035 and pages 4-5, paragraph #0055). 
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Regarding claim 49, Kwoh et al discloses the claimed wherein the marking data 
defines the marking time directly (page 2, paragraph #0035). 

Regarding claim 52, Kwoh et al discloses the claimed wherein the marking data 
further defines a range of time relative to the marked time (page 2, paragraph #0035 
and pages 4-5, paragraph #0055). 

Regarding claim 53, Kwoh et al discloses the claimed wherein the step of 
identifying further comprises: 

Identifying an indication that a voice mark is to be imminently specified (page 2, 
paragraph # 0035); and 

identifying a voice mark (page 2, paragraphs #0035 and #0036) in response to 
an indication that a voice mark is to be imminently specified. 

4. Claims 6-7 and 50-51 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kwoh et al (US 2002/0031331 Al) in view of Cobbley et al (US Patent No. 
5,818,510) as applied to claims 1 and 45 above, and further in view of Abecassis ('814) 
as set forth in the last Office Action. 

Regarding claim 6, the combination Kwoh et al and Cobbley et al discloses all 
the features of the instant invention as discussed in claim 1 above except for providing 
that the marking data further defines a confidence level that represents the certainty of 
the recorder that the marked recording data is the recording data that the recorder 
desires to mark. 

Abecassis teaches a variable-content video retriever having means for marking 
data defines a confidence level that represents the certainty of the recorder that the 



Application/Control Number: 09/557,081 Page 13 

Art Unit: 2616 

marked recording data is the recording data that the recorder desires to mark (cols. 8- 
9). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate segmenting the video signal into G, PG, PG-13, R, NC-17 rating 
segments as taught by Abecassis into Kwoh et al's system in order to prevent an 
unauthorized viewer to watch recorded video signal. 

Regarding claim 7, Abecassis teaches the claimed wherein the value of the 
confidence level defines a range of time relative to the marked time (cols. 8-9). 

Method claims 50-51 are rejected for the same reasons as discussed in 
apparatus claims 6-7 above. 

5. Claims 37-38 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kwoh et al (US 2002/0031331 A1) in view of Cobbley et al (US 5,818,510) as applied to 
claim 36 above, and further in view of Cruz et al ('032) as set forth in the last Office 
Action. 

Regarding claim 37, the combination of Kwoh et al and Cobbley et al discloses 
all the claimed features of the instant invention as discussed in claim 36 above except 
for providing the claimed wherein the system controller causes recording data 
corresponding to the at least one mark to be compressed in accordance with the level of 
importance or interest represented by the mark. 

Cruz et al teaches a system and method for recording, playing back and 
searching multimedia event wherein video, audio and text can be searched and 
retrieved having means for indicating that a voice mark is to be imminently specified 
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(col. 6, line 55 to col. 7, line 37) and that the system controller causes recording data 
corresponding to the at least one mark to be compressed in accordance with the level of 
importance or interest represented by the mark (col. 6, lines 37-54). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the searching apparatus as taught by Cruz et al into Kwoh et 
ars system in order to searching the desired audio signal in multimedia data. 

Regarding claim 38, Cruz et al discloses the claimed wherein the system 
controller causes compression of recording data to be reduced after the predetermined 
amount of time (col. 6, lines 37-54). 

6. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kwoh et 
al (US 2002/0031 331 A1 ) in view of Cobbley et al (US Patent No. 5,81 8,51 0) as applied 
to claim 1 1 above, and further in view of Horio et al ('876) as set forth in the last Office 
Action. 

Regarding claim 12, the combination of Kwoh et al and Cobbley et al discloses 
all the features of the claimed invention as discussed in claim 1 1 above except for 
providing means for mounting one or more components of the recording unit on the 
body of the user. 

Horio et al teaches a electronic camera having means for mounting the recorder 
on the person of the recorder (Fig. 5) to ease the user in carrying the recorder from one 
place to another. 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate means for mounting the recorder on the person of the recorder 
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as taught by Horio et al into Kwoh et al's system in order to ease the user in carrying the 
recorder from place to place. 

7. Claims 22-23 and 43 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Kwoh et al (US 2002/0031331 Al) in view of Cobbley et al (US Patent No. 
5,818,510) as applied to claims 15 and 41 above, and further in view of Murphy et al 
(US Patent No. 6,282,362 B1 ) as set forth in the last Office Action. 

Regarding claim 22, the combination of Kwoh et al and Cobbley et al discloses 
all the features of the claimed invention as discussed in claim 15 above except for 
providing wherein the multiple types of marks include one or more privacy marks. 

Murphy et al teaches digital memory storage has an additional advantage over 
conventional video or film recording of images and locations in that encryption of the 
image and location data may be done in such a way that the data could be securely 
protected against subsequent alteration, for example, by locking the recorded 
image/location data file against rewriting, thereby providing a more defensively robust 
legal record (col. 6, lines 56-62). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of encrypting (one or more privacy marks) the 
digital data recorded on the digital memory storage as taught by Murphy et al into Kwoh 
et al's system in order to securely protected against subsequent alteration of the 
recorded data. 
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Regarding claim 23, Murphy et al teaches the claimed wherein the one or more 
privacy marks includes a mark that indicates that the marked part of the recording is to 
be erased (col, 6, lines 56-62). 

Regarding claim 43, Murphy et al also teaches the digital data recording unit 102 
having the claimed wherein the means for acquiring data other than recording data 
further comprises a position sensing device (geographical position detector (GPD) 110 
disclosed in col. 8, lines 45-54) for storing video data and position data. 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of recording the position data along with the 
image signal as taught by Murphy et al into Kwoh et ars system in order to increase the 
flexibility of the system of Kwoh et al by recording position data along with the image 
video signal. 

8. Claims 24-26 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Kwoh et al (US 2002/0031331 Al) in view of Cobbley et al (US Patent No. 5,818,510) 
as applied to claim 1 above, and further in view of Konishi ('381) as set forth in the last 
Office Action. 

Regarding claim 24, the combination of Kwoh et al and Cobbley et al discloses 
all the features of the instant invention as discussed in claim 1 above except for 
providing the claimed wherein the multiple types of marks include one or more marks 
indicating different recording units. 

Konishi teaches that, with the electronic camera, it is possible to easily record 
various other data, such as date of photographing, shutter speed, aperture value, frame 
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number, place of photographing, name of photographer and object, and various kinds of 
memo data or the like, on the same recording medium on which the object image 
information is recorded, by converting the data to electric signals so that, in the scientific 
field, the system can be study by using said various other data (col. 1, lines 35-68). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of recording data such as date of photographing, 
shutter speed, aperture value, frame number, place of photographing, name of 
photographer and object, and various kinds of memo data or the like on the same 
recording medium along with the image data as taught by Konishi into Kwoh et al's 
system in order to determining whether to improve the system of Kwoh et al by studying 
said data. 

Regarding claim 25, Konishi further teaches the claimed wherein the multiple 
types of marks include one or more marks identifying the person making the mark (col. 
1, lines 35-68). 

Regarding claim 26, Konishi discloses the claimed wherein the multiple types of 
marks include one or more marks identifying a person appearing in the part of the 
recording represented by the recording data associated with the mark (col. 1, lines 35- 
68). 

9. Claim 42 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kwoh et 
al (US 2002/0031 331 Al ) in view of Cobbley et al (US Patent No. 5,81 8,51 0) as applied 
to claim 41 above, and further in view of Nickles ('335) as set forth in the last Office 
Action. 
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The combination of Kwoh et a! and Cobbley et al discloses all the features of the 
instant invention as discussed in claim 41 above except for providing wherein the 
means for acquiring data other than recording data further comprises a physiological 
monitoring device; and the means for producing a mark and/or supplementing or 
modifying an existing mark produces, supplements or modifies based on the value of, or 
an analysis of, physiological monitoring data. 

Nickles teaches, in hospital for diagnostic and research purposes, a device for 
the multiplexing of time varying amplitude physiological data signals with the signals 
that are provided to a data processing computer from the photomultiplier tubes of a 
gamma ray camera (col. 1, lines 13-23 and col. 2, lines 52-63). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the capability of multiplexing of time varying amplitude 
physiological data signals with the signals that are provided to a data processing 
computer from the photomultiplier tubes of a gamma ray camera as taught by Nickles 
into Kwoh et al's system in order to study the image signal by using the physiological 
data. 

1 0. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
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shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .1 36(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action, 

1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Thai Tran whose telephone number is (571) 272-7382. 
The examiner can normally be reached on Mon, to Friday, 8:00 AM to 5:30 PM, 

The fax phone number for the organization where this application or proceeding 
is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR, 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 
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